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Abstract 

In these notes we review first in some detail the concept of random overlap 
structure (ROSt) applied to fully connected and diluted spin glasses. We 
then sketch how to write down the general term of the expansion of the 
energy part from the Boltzmann ROSt (for the Sherrington-Kirkpatrick 
model) and the corresponding term from the RaMOSt, which is the di- 
luted extension suitable for the Viana-Bray model. 

From the ROSt energy term, a set of polynomial identities (often known 
as Aizenman-Contucci or AC relations) is shown to hold rigorously at ev- 
ery order because of a recursive structure of these polynomials that we 
prove. We show also, however, that this set is smaller than the full set 
of AC identities that is already known. Furthermore, when investigating 
the RaMOSt energy for the diluted counterpart, at higher orders, combi- 
nations of such AC identities appear, ultimately suggesting a crucial role 
for the entropy in generating these constraints in spin glasses. 

1 Introduction 

The study of mean field spin glasses is very challenging from both a physical 
[29] and a mathematical |39j point of view. Concerning the latter, an increas- 
ing amount of work has, in recent years, developed sophisticated mathematical 
techniques and used these to confirm several scenarios from theoretical physics 

(e.g. ® [II3H]] [T§] [23 EE] IS])- 

Despite all the results that have been obtained by several techniques that avoid 
the replica trick (e.g. cavity field [2H1HB]: stochastic stability [TSJIH], stochastic 
calculus [131 ES] and others [2 GS3) — including, of fundamental importance, 
the correctness of the Parisi expression for the free energy [25] [10] — the ques- 
tion of its uniqueness is still a subject for debate. This brings with it also the 
question of whether ultrametricity, with all its peculiarities, necessarily holds 
[23- Recently, fundamental progress has been made connecting ultrametric- 
ity to polynomial identities 0(32133], mainly Ghirlanda Guerra relations (GG) 
|22| , highlighting the importance of polynomial identities in the analysis of mean 
field spin glasses. 
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One of the key approaches in the field is the powerful and physically profound 
concept of Random Overlap Structures (henceforth ROSt) introduced by Aizen- 
man, Sims and Starr in [3]. 

In this work we want to deepen our understanding of a certain kind of polynomial 
identities, known as Aizenman-Contucci identities (AC) pQ. These characterize, 
in a sense, the peculiar structure of the spin glass phase( as there is a deep link 
between AC polynomials and GG identities) [22] [31] within the framework of 
ROSt, both for fully connected (Sherrington-Kirkpatrick, SK |23_38J) and for 
diluted (Viana-Bray, VB [21] [2]) systems. 

We show how to systematically derive AC relations from the energy contribu- 
tion of the Boltzman Random Overlap Structure, once a Hamiltonian is given. 
Interestingly, we find that only a subset of the whole set of known identities 
can be obtained. Furthermore, when looking at the diluted counterpart, where 
a Parisi theory has not yet been fully achieved, we show that at high orders of 
expansion, the AC-like relations come out but combined into larger identities: it 
is not trivially possible to split them again to show that they are zero separately. 
In section [2] we introduce the general concept of Random Overlap Structures. 
Then, in section[3]we show in general terms our technique for finding the desired 
polynomial identities. In section 4 we apply the idea to the Boltzmann ROSt 
for the SK model, while in section 5 we test it on the Boltzmann RaMOSt for 
the VB case. Section 6 is left for discussion and closes the paper. 

2 Random overlap structures 

In a nutshell, the ROSt generalizes the single spin cavity approach [B] 24J [23 
into one of several (and possibly many) added spins. These are in contact with a 
larger "bath" with its own interaction matrix. The ROSt allows the properties 
of this bath, including the overlaps between different states, to be specified in 
a very flexible manner by a trial random structure which interacts with the 
original set of cavity spins. This then permits one to represent the pressure of 
the SK model as the infimum over a family of such trial structures in a set of 
probability spaces. 

The Parisi ROSt 4 [37 , which has states lying on an ultrametric tree [TB] [H] , 
has the property of optimality with respect to this principle (i.e. it is one way 
of realizing the infimum). It is thought to coincide with the (conceptually much 
simpler) Boltzmann ROSt (24) introduced by Guerra, which was shown to share 
with the former the same optimality. 

2.1 Introducing the ROSt for the SK 

Let us start from a system of M + N spins: we label the N spins <j\, . . . , ctat 
and think of them as cavity spins, and denote the M spins by ri, . . . , tm and 
think of them as the environment (the thermal bath) for the cavity. 

The size M of the bath is now made large, at fixed N. An important effect 
of taking this limit is that the fields acting on the cavity spins are dominated by 
their interactions with the bath rather than their interactions with each other. 
In the limit M — > oo the cavity spins then become effectively non-interacting 
with each other and live in uncorrelated fields whose statistics are governed by 
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those of the bath. We will now detail this important motivation for the ROSt 
approach. 

We define and decompose the Hamiltonian Hm+n(&, t) of the overall M +N- 
spin system as 

H M +n(<J,t)= 1 ^ JklTkTl (1) 

y/M + iV 1 < fc<i < M 
v ^ l<fe<M,l<i<iV v l<i<j<N 

where the relevant interaction variables Jki , Jki and Jy are all independent 
standard Gaussian random variables. Now call the first term in the Hamilto- 
nian ([T]) Hm+n(t) and write the second one as J2i<i<N h-i( T ) a i with hi(r) = 
- ^m +n J2i<k<M JkiTk which for large M becomes 

hi(r) = --i== E Jk%Tk- (2) 

* l<k<M 

The third contribution in (JTJ) , which has the interactions among the cavity spins, 
is a sum over only iV 2 terms. This is at most 0(N 2 / \J (M + N)) and goes to 
zero for M — > oo as anticipated. 

Similarly the Hamiltonian governing the M-spin bath can be written as 

Hm{t) = h m+n (t) - (-"- - j^-^) 1/2 E JklTkTl 

l<k<l<M 

Here the random interactions Jki are independent from all others (and not 
related to the above, the latter referring to a-a interactions). The above 
decomposition of Hm(t) can be understood by noting that it gives for each 
bond strength a variance of 1/(M + N) + 1/M- 1/(M + N) = 1 /M as it should 
be. For large M we can then write 

H m (t)=H m+n (t) + J^H(t), H(t)=-^ E JklTkTl - 

l<k<l<M 

Putting both together gives for large M at any fixed ./V for the difference between 
the log partition functions of the M + N and M-psin systems 

Eln W(fl =Eln i^ll (3) 

Z M (/?) ^ e -/3ff M+J y(r)-^(JV/2)V2H( T )' > 

where E represents the disorder average over the couplings. 
Now let us call 

and symmetrize H(t) w.r.t. the ordering of k and I by defining i.i.d. unit Gaus- 
sian random variables Jki for all pairs (fc, /) such that 

l<fc^i<M 
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We can also add the diagonal terms and modify H(t) to 

k ^ = -Ti £ JklTkTl - ( 6 ) 

l<k,l<M 

The resulting extra Gaussian random contribution is r-independent and so pulls 
through the sum over all r and the logarithm in ([3]) to appear linearly in the 
expectation over disorder, where it then vanishes. Calling P{0) the thermody- 
namic pressure, defined in terms of free energy density /(/?) as P(/3) = —/?/(/?) 
and using E In Z M+N (0) = (M + N)P(j3) for large M gives finally 

KH> N Z M (P) N <£ T Z(T)e-PW 2 ) 1/aB <r) y ' 

The hi(r) and H(r) are all zero mean Gaussian random variables. The two 
families of variables are uncorrelatcd with each other, while within the families 
the covariances are 

E^(t)Mt') = ]T T k T' k ^S %3 q(T,r') (8) 

l<fc<M 

EH(t)H(t') = -L T k nr' k Tl = q 2 (T,T'). (9) 

l<k,l<M 

A Random Overlap Structure or ROSt is a generalization of the above struc- 
ture which allows one to describe more generally (for example in terms of a Parisi 
ultrametric tree) the states r of the bath for the cavity spins a. Similarly the 
overlaps between these states are left unspecified, and hence denoted with a 
tilde, as are the weights £(r). 

Let us then start by defining a Random Overlap Structure 71 as a triple 
(S, q, £) where 

• £ is a discrete space; 

• £ : £ — > R+ is a system of random weights; 

• q : E 2 — > [—1, 1] is a symmetric Overlap Kernel, with g(r, t) = 1. 

Now consider two families of independent centred Gaussian random variables h, 
and H, defined on E 9 t, such that there are N variables hi(r), for each r and 

E(h i (r)h j {T J )) - g(r,r')% , E(£(t)£(t')) = g 2 (r,r'). (10) 

Then the Generalized Trial Pressure can be written as 

C » W -lEb,^« T) ^- g ^M r) "'. (ID 
W E T «Mexp(-,3(JV/2)V2ff(T)) 

In the following two subsections we outline the properties of the ROSt defined 
above, following the presentation in [3], [24]: we state the required theorems 
concerning the optimality of the ROSt and we introduce the Boltzman ROSt, 
referring the interested reader to the original papers for the proofs. 
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2.2 The Boltzmann ROSt 

Equations (I2I4I6I) define the Boltzmann ROSt [23], with one exception. In the 
Hamiltonian Hm+n{t) that defines the weights £(t), and is given by the first 
term on the r.h.s. of ([T]), the normalizing prefactor 1 / \[M + N is replaced by 
1/yM. This is equivalent to replacing this Hamiltonian by Hm(t), which rep- 
resents only the interactions within the bath. 

On a superficial level, this change is necessary to comply with the general def- 
inition of a ROSt: the weights £(t) must not depend on N. At first sight it 
looks dangerous, however for the dominant states r, Hm+n{t) is 0{M), and 
the change of the prefactor by \/ (M + N)/M = 1 + N/(2M) modifies the 
Hamiltonian by a term of O(N) that remains non-negligible even for large M. 
Fortunately, the prefactor shift can alternatively be regarded as a slight tem- 
perature shift to (i* = Py/ (M + N)/M. Evaluating ([7]) at this temperature and 
using /3*H m +n{t) = 0H m (t) gives 



V p -PH M {T) e -py/{M+N)/M E 4 hi{r)<7i 



P{J3^M + N/M) = — E In : . (12) 

' ' N £ e -PH M {T) e -P\fM+NjM{N/2y/*H{T) 



The two exponents on the r.h.s. where the factor yj (M + N) jM now appears 
do not grow with M so in them one can replace y/(M + N)/M by 1 for large M. 
Similarly, as the pressure is a continuous function of the inverse temperature, 
the l.h.s. tends to P((3) for large M. This shows that (0 remains correct if we 
define the weights as £(r) = exp(— /3Hm(t)), as claimed. 

If we now call TZb(M) the Boltzmann ROSt we have just defined, one can 
prove the following 

Theorem 2.1 (Reversed Bound). 

-/3f(/3)> lim liminf G N (TZ B (M)) 

N— too M— >oo 

The idea of the proof, which we do not elaborate here, is to compare Gn (7?- b (M)) 
with 

±Eln ZN+M(J3) 
N^ m Z M ((3) 

The following theorem states that the generalized trial pressure provides an 
upper bound on the SK model pressure, i.e. a lower bound for the free energy. 

Theorem 2.2 (Generalized Bound). 

-/3f N (P) <MG N (U) . 

From the two previous theorems one gets immediately the following 
Theorem 2.3 (Extended Variational Principle). 

-0/09) = lim MG N (K). 

N^oo 1Z 

The theorem implies that it is sufficient to limit our trial functions to those 
depending on trial overlaps, like those in the ROSt space, and expressed as 
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the difference between a cavity term and an internai energy part, as in the 
numerator and denominator of the generalized trial pressure Gjy- 

We will first decompose the generalized trial pressure G(1Z) from (fTTj) . eval- 
uated for the Boltzmann ROSt TZb(M), into two parts. Seeing as the weights 
£(t) = cxp(— /3Hm(t)) of the bath configurations r are simply Boltzmann 
weights, we can introduce the notation 

(F) _ £ T F(T)exp(-/3g M (r)) 
1 > E t cx P (-Pm(t)) 

for the bath Boltzmann state. The generalized trial pressure can then be written 
as 

G N (K B (M)) = iElnw (^eM-Pj2~hi^-Jj Eln " |cxp(-^fl)J . 

(13) 

We will see that this decomposition mirrors exactly the one in [6] , and therefore 
call the second term the "internal energy term" and the first the "entropy term" . 
These names are not quite precise but act as convenient shorthands. If e(/3) is 
the SK internal energy, then the internal energy term is in fact — (l/2)/3e(/3), 
while the entropy term contains in addition to the entropy a contribution of 
-(3/2)/3e(/3). 

Let us now consider the internal energy term of the Boltzmann ROSt gen- 
eralized trial pressure, but with the /? in the exponent generalized to some /3' 
that can be different from the inverse temperature defining the bath Boltzmann 
state. Thanks to the stochastic stability of the Gibbs measure [14], one can 
show that this affects the result only through a prefactor 18] , as stated in the 
following 

Theorem 2.4 (The energy expression). For M — > oo, 

lElnccxp L^y^F(T)J = ^(1 - <&». (14) 
On the r.h.s., (•) = Ef2(-) and Q is the replicated bath Boltzmann state oj. 



2.3 Introducing the RaMOSt for the VB 

The RaMOSt plays a role analogous to that of the ROSt for the SK when dealing 
with diluted system such as the Viana-Bray model (VB) [IT]. A fundamental 
difference is that we now need another real parameter a to take into account 
the connectivity of the underlying random graph. We recall here that the VB 
model is a spin model defined on a random graph, with interactions only present 
on the edges of the graph. 

As in the SK case, to motivate the RaMOSt, consider a cavity of N spins 
(Ti , . . . , ctat in a "bath" of M spins ti, . . . , tm, with M ^ N. The aim is to obtain 
the pressure by considering the free energy increment when going from M to M+ 
N spins, P((3,a) = (l/7V)E[ln Zm+n(P, ol) — Zn(P, &)]• Based on experience 
with the SK model, where we had to allow for a slight temperature shift to 
construct the Boltzmann ROSt, we allowed here for a shifted connectivity a 
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which should approach our desired connectivity a when M/N — > oo. To write 
the partition function of the (M + iV)-spin system, decompose the Hamiltonian 
as in [5] 

p c Pi _ P c , 

- H m +n{<7, t, a) = ^ JvT iv Ti v + 2J JvTi„Vj„ + X! K^i'^K ■ (15) 

i^— 1 i/— 1 

All the J-variables here are i.i.d. interaction strengths, distributed symmetri- 
cally about zero (e.g. binary values ±1 as used in the following, or zero mean 
Gaussian variables; the precise choice should be unimportant as mean field spin 
glasses are thought to display universality [H]). The spin indices i v etc are uni- 
formly distributed across {1, . . . , M} or {1, . . . , N} as appropriate. The upper 
summation limits etc. are Poisson random variables with mean number of 
bonds in each "sector" given by 

M 2 -__ 2MN _ N 2 

C ~ a M + N ' C ~ a M + N ' C ~ a M + N ' 

For example, the total mean number of bonds is by definition (M + N)a; there 
are M 2 "tt" spin pairs out of a total of (M + N) 2 and hence ( = a(M + 
N)[M 2 /(M + N) 2 } = aM 2 /(M + N). To make the tt part of the Hamiltonian 
equivalent to an M-spin Hamiltonian with connectivity a, we need £ = aM and 
thus 

" M + N 

a = a — . (16) 

As £' - > for M — > oo at fixed N, this term in Hm+n can be discarded with 
probability one: as in the SK case, making the bath large enough allows us to 
neglect interactions of the cavity spins. Summarizing so far, we have for large 
M 

/ PcM P2cN \ 

Z m+n {(3, a) = J^exp /3 ^ JuT 1v ti v + (3 ^ J^a^ 

(T.T \ V— 1 V— 1 / 

= ^vq>(-j3H M (T,a)-j3H(a,T,af) (17) 

(T.T 

where 

PlcN N 

H(a, T,a) = -^2 Jvn^ju = ^'( T ) CT i • ( 18 ) 

v=l j=l 

Here hj (r) is the cavity field acting on <jj defined by 

and the index j of and V v indicates independent copies of the corresponding 
random variables. The first form of H given in (1181) is more useful for our 
calculations, while the second one emphasizes the physics: as in the SK model, 
each cavity spin <jj experiences a cavity field arising from its interaction with 
the bath. In the VB case, this field is due to a Poisson-distributed number (with 
mean 2a) of interactions with randomly chosen spins Ty from the bath. 
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To write the partition function of the M-spin system with connectivity a in 
a similar form, we write its number of bonds as PaM = PaM + PaN- 

/ PcM PcN \ 

Z M {P, a) = ^ exp /3 ^ J v T iv n v + (3 ^ Jv T l„ T i„ 

T \ V=l V=l ) 

(-PH M (T,a)-/3H(T,aj) (19) 



exp i 



where 



P a N 

H(T,a) = -J2^n,r iv ■ (20) 
i/=i 

Defining Boltzmann weights £(t) = cxp(— /3Hm (t, a)), we can then write for 
large M 

P(ft „) = 1e ■„ gg±# f » ' , b, E " «^-'"-"' . (21) 

^ N Z M {P,a) N ^ T ^( r ) e -^H(r, Q ) v 7 

By default the connectivity at which the pressure is found in this way is a, but 
we have already exploited the fact that for large M this tends to a. 

In order to think at the above representation of the pressure (which so far we 
have mainly tried to motivate, without being rigorous) as the generalized trial 
pressure of a Random Multi- Overlap Structure (RaMOSt), we need to show 
that the statistics of H and H can be expressed in terms of multi-overlaps of 
the bath states r. To see this, note that the definitions (|18p and (|2T)|) of both 
quantities can be written in terms of sums over i.i.d. variables: 



H(r,a) = X>"(r), (22) 
j/=i 

PlcN 



where h v (r) and h u (r) are independent copies of random variables h(r) and 
h(r). The latter form two independent families of random variables indexed by 
r, whose probability distributions have even moments 

E[h(r 1 )---h(r 2n )} = (EJ 2n )qUr\...,r 2n ), (24) 
E^r 1 ) • • • h(r 2n )} = (EJ 2n )q 2n (r\...,T 2n ), (25) 

while the odd moments vanish. These properties follow from the fact that in 
our construction so far h(r) = Jt}Tj and h(r) — Jtj. The bath multi-overlaps 
occurring above are then 

g 2 „(T\...,r 2 ") = -L J2 tf-'f- (26) 

1<%<M 

We can now generalize and allow generic ways of specifying the states r of 
the bath and their multi-overlaps qi n . At this point it is clear that we have 
outlined essentially the same setting as the one we used for the SK model, and 
the previous remarks allow us to introduce the Random Multi- Overlap Structure 
1Z as a triple (£,{q2n},£) where 
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• £ is a discrete space; 

• £ : X — > K + is a system of random weights; 

• q 2n : S 2 " — >• [— 1,1], n € N is a Multi-Overlap Kernel. This needs to be 
such that (j!MIl2"5)) define valid random variables h(r) and h(r), and in par- 
ticular each q 2n must be symmetric in its arguments. The multi-overlap 
kernels for different n must also be linked by the following reduction prop- 
erty: q 2n+2 (r, t,...) = q 2n (. ■ .) for n e N and q 2 (r, r) = 1. 

The generalized trial pressure for such a RaMOSt is then defined as 

G N (K) = £^12 = , (27) 

where the statistics of the random variables -ff (<r, r, a) and i? (t, a) are as defined 
by (gUS]). 

Note that the factorization of (j24l l25j) implies that /i"(t) and h v {r) can be 
written as Je l/ (r) and Je l/ (r). The reduction property of the kernel then further 
shows that e(r) and e(r) are binary (±1), because all their even moments are 
unity (E[e 2rl (r)] = gfn ( T > ■ ■ ■ > T ) = 1 an d similarly for e) while the odd ones 
vanish. 

We will call the RaMOSt introduced above, where S = {-1,+1} M , ^(r) = 
exp(— 0Hm{t, ct)) are Boltzmann weights and the multi-overlaps are as in (l26l) . 
the Boltzmann RaMOSt TZb(M). The reduction property is then entirely nat- 
ural: even numbers of replicas cancel to give e.g. q^r 1 , t 1 , t 1 , t 2 ) — q 2 (T 1 ,T 2 ) 
and q±(T l ,T l ,T 2 ,T 2 ) = q 2 (T 2 ,T 2 ) = 1. 

The generality of the RaMOSt allows one, on the other hand, to take S 
(which is not necessarily { — 1, +1} M ) as the set of indices r of the weights £(r) 
constructed by means of Random Probability Cascades of Poisson-Dirichlet pro- 
cesses (see e.g. Ref. [5Tj). These cascades give rise to nested chains of expec- 
tations of Parisi type, and reproduce the Parisi Replica Symmetry Breaking 
theory if one interpolates according to the iterative approach of Refs. [2T1 15T| . 

2.4 The Boltzmann RaMOSt 

Now to acquire familiarity with the RaMOSt framework we state a package of 
theorems mirroring the Aizenman, Sims and Starr theory for the SK free energy 

m 

Consider for t e [0, 1] and a given RaMOSt 1Z the following interpolating Hamil- 
tonian 

H{a, r, t) = H N (a, to) + H(t, to) + H(a, r, (1 - t)a) 
and using the RaMOSt weights £(t) define 

9NW = T7 Em ■ (2°) 

N E r e(r)exp(-^(r,a)) 

Clearly then 

9n(0) = G N (K) , 
g N (l) = -(3f N (p,a) . 

Within this construction the following results easily follow [21 U\ ■ 
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Theorem 2.5 (Generalized Bound). 



P N (P,a) = -f3f N (f3,a) < MG N (K) . 

Theorem 2.6 (Reversed Bound). 

P(/9,a) = -13 f (13, a) > MG N (K) . 

Theorem 2.7 (Extended Variational Principle). 

P(j3,a) = -Pf(P,a) = lim miG N (K) . 

N— >oo TZ 

Theorem 2.8 (The energy expression). Let lu, (■) be the usual Boltzmann- 
Gibbs and quenched Boltzmann-Gibbs expectations at inverse temperature f3, 
associated with the Hamiltonian Hn(o~,ci). Then 



lim Elnwexp (3'^J'^a^ = a ^ — tanh 2 "(/3')(l 

v i/=l ' n—\ 



(9 2 2 „», (29) 



where the random variables { J' v }, and are independent copies of the 
analogous random variables appearing in the Hamiltonian in w, and P & is a 
Poisson random variable with mean a. On the r.h.s. the quenched Boltzmann- 
Gibbs expectation is of the square of the multi- overlap qi n of n replicas of the 
system, defined as in 



3 The general expansion of the "energy" term 

We want to expand the "energy" term 

e = E1nn(exp[-p' H(t)]) (30) 



in f3' in order to compare this expansion with the r.h.s. of Eq. ([14]) for the SK 
model and Eq. I|29p for the VB model. We use f2 to denote the Boltzmann 
measure of r (whose form will not matter), both for a single replica and later 
also for the corresponding replicated measure. 

In this section, we find a suitably general form of the expansion of e, which does 
not rely on the specific form of H(t). 
We expand first the exponential 



n(exp[-f3'H(T)]) = 1 + ]T 



(-0') n 

77. ' 



(31) 



n>l 



and then the log to get 
(_!)m-l 



E 

m>l 



E 



(-/?') 



/\ni+...+n„ 



-E 



rti . . .rim >1 



n(H ni (T))---tt(H nm ( T )) 



The expectation appearing here can be rewritten as 



EQ 



Hir 1 ) ■ ■ ■ H(T r ) x ■ • • x H(r n ) ■ ■ ■ H(r n ) 



(32) 
(33) 
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where replica t 1 appears n\ times, r 2 appears 112 times and so on. Now group 
terms according to n = n\ + . . . + n m , bearing in mind that n > to, and use the 
shorthand (...)= EQ(. . .): 



^— J n\ to ^ n\\---n m \ 

n>l m—1 ni . . .n m >l.ni +...+n m — n 

x {H{T 1 )---H{r 1 )x---y. H{ T n )---H{T n )) (34) 

The combinatorial factor n\/(n\\ ■ ■ • n m \) just gives the number of permutations 
of the replica indices inside the (...), so one can write equivalently 

I fl'\n " I 1 \m- 1 ' 
n>l m—1 l<ai ,...,a n <m 

The prime on the last sum corresponds to the constraints m, . . . , n m > 1: only 
terms in which each of the m replicas appears at least once are to be included. 
In other words, as an identity between sets (where multiple occurrences count 
as one) we must have {ai, . . . , a„} = {1, . . . , to}. 

We now exploit permutation symmetry of replicas to modify the sum over 
a\,...,a n by expanding its summation range. This looks more complicated 
initially but will pay dividends shortly by producing unrestricted sums. From 
permutation symmetry, our expansion is unchanged if we let ai,...,a n take 
values in some general subset T of {1, ... , n}, of size |T| = to. The constraint 
on the summation would then be \{a\, . . . , a n }\ =T. We can now sum over all 
n!/[m!(n — m)!] possible choices of T and divide by this factor. The possible 
assignments of a\, . . . , a n that result from this summation over T are clearly all 
distinct, and together give precisely all the assignments of a\, . . . , a n — in the 
now expanded range 1, . . . , n — for which the set {ai, . . . , a n } has exactly m 
elements. If we denote this constraint with a superscript (to) on the sum, we 
have 

. - y Hgy (-')-' "■("-")■ v <*( T «)-H(T-)>, 

n>l m—\ l<ai, ...,o n <n 

(36) 

but now the sum over m together with the constrained sum over the a\, . . . , a n 
just yields an unconstrained sum. We just need to bear in mind that the coef- 
ficient is rn-dependent, i.e. 

e = E^7? E {-ir-\m-l)\{n-m)\{H{T^)---H{r^)), (37) 

n>l Kai,....a„<n 

where now m = \{a\, . . . , a n }\ is a function of the a\, . . . , a n which counts the 
number of distinct members in the set of replica indices {ai, . . . ,a n }. This is 
our desired general expansion, where now only unconstrained sums appear. In 
our cases of interest, the averages over H vanish for odd n and we need only 
the even terms, i.e. after relabelling n — > 2n 

ol2n 

e = E 7^ E (-l) 7 "" 1 ^ - l)!(2n - m)\{H(r^) ■ ■ ■ H{r^)). 

n>l ^ '' l<oi a 2n <2n 

(38) 
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4 Expansion in the SK model 



For the SK model, we want to verify whether the identities we get are indeed of 
AC form Q], and to determine if and which subset of AC identities they produce. 
Note that the expansion parameter in e is in principle /3'y/ N/2 instead of j3'. 
We keep (3' for now; the original version can be retrieved at any point trivially 
by reinstating /3' /3' y/ N/2. The perturbation Hamiltonian in the exponent is 

H(r) = -jjJ2j^i ( 39 ) 

M 

with the Jki i.i.d. Gaussian random variables of zero mean and unit variance. 

To simplify the expansion (1381) we carry out part of the disorder average, 
over the Jki ■ Consider 

(H(T ai ) ••• H{t cl ^)) = (40) 

fcl,/i,...,fc2Ti,^2Ti 



Wick's theorem gives a sum over pairings of the various indices (k±, (fe, I2) 
etc., or equivalently pairings of the replica indices a%, . . . , «2n- This can be 
written as a sum over permutations 7r of 2n elements if we bear in mind that 
we then overcount each pairing 2 n n\ times: 

(H{r ai ) ••• H( T a2 ")) = 

= -L-M- 2n Y Y (r'M!) ^U) ^(2> <M2, ... 

2 n nl ' J 1 1 1 1 

T "'(2»-l) a 7r(2 n -l) ".(2„) «,(2„) 1 _ 

' ' ' k n T l n T fc„ T Z„ / — 

= —Y(q 2 ■■■q 2 )■ (41) 

Now we insert this into the general expansion (|38p . Because the summation 
over ai, . . . , d2n is symmetric, each permutation n gives the same contribution 
and the sum over n therefore just yields a factor (2n)! so that 



e SK 



E/ 3 ' 2 "^) ( 42 ) 



with 



* ' l<ai a,„<2n 

(43) 

This form of the result is beginning to look useful, but there is the compli- 
cation that, when e.g. a\ = <?a ia2 = 1 so it looks like various orders of q 
are mixed. We therefore next show that the sum can be restricted to the terms 
were a± ^ 02, 03 ^ 04 etc. To see this, insert into the sum appearing in the 
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expression for E^ K a factor 

1 = [Ci--S ai a 2 ) + S ai a 2 }---[(1-S a2n _ 1 a 2n ) + S a2n _ ia2n } (44) 
(1 — ^aia 2 ) (1 — ^a2„-ia2„) 

~l~ ^aia2(l ^0304) ' ' ' (1 ^a2Ti-ia2n) * " ' 

^0102^0304(1 <5a5a 6 ) (1 ^a27i-ia 2 „) + • • • 
+ • • • 

"I" ^oia 2 ' ' ' ^a 2 „-ia2„ ■ 

We want to show that all the terms containing at least one factor S a i, (i.e. 
all except those in the first line) vanish once summed over. This is easy to 
see. Consider without loss of generality S a2ri ia2ri and fix all other summation 
indices. Call the set of these indices S = {a%, . . . ,020-2} and its size s = \S\. 
Now do the summation over <Z2 n _i = a,2 n in (02), noting that the average (...) is 
independent of which value a2 n -i takes (since g„ 2 a = 1). Only to varies: 
either to = s if a.2n-\ G S, or m = s + 1 if ci2 n -i ^ S. There are s values of 
Q-271-1 where the first case occurs, and 2n — s values for the second case. Thus 

(-ir(m-l)!(2n-TO)!(...) = 

l<a2 ?1 — 1 — a 2 ,2 < 2 7i 

s{-l) s (s - l)!(2n - s)\ + (2n - s)(-l) s+1 s!(2n - s - 1)! = 0, 

and any summation over the remaining indices a\,. . . ,a2n-2 (whether or not 
they contain further pairs of identical indices) of course then also gives a van- 
ishing result. There is one exception to this argument: if n = 1 then ,s = 0, and 
to = 1 whatever the value of a\ — here no cancelation can occur (mathe- 
matically, the breakdown of the argument is reflected in the appearance of the 
divergent factor (s — 1)! = (—1)! above). The n = 1 term is therefore separated 
off explicitly below. 

We have now shown that in f|42[) we need to consider only distinct summation 
indices within each pair, i.e. a\ ^ 02 etc. We can further order the indices within 
each pair and then need to multiply by a factor 2™ to compensate, giving (the 
S n i term accounts for the non-canceling term at n = 1) 

ET = -5^ + ^! £ (-l) m (m-l)!(2n-m)!^ a2 ---^ 2n _^5) 

'' o.p.<2n 

1 i (m) f--n m 

= -\ 5 ^ + h. £ £ (46) 

2<m<2n o.p.<m 

The subscript "o.p." indicates a sum over ordered pairs, 1 < a% < 0,2 < 2n, 
1 < 03 < 04 < 2n etc. In the last row of eq. (|46[) we have re-introduced a sum 
over to and a constrained sum over (ordered pairs of) replica indices with to 
distinct elements. We have then further compressed the summation range of the 
replica indices to 1, . . . , to, multiplying by (2n)!/[m!(2n — to)!] to compensate. 
Notice that in this last version, E^^ is no longer symmetric under permutation 
of the replicas. But as we only need E^ K under the expectation (£^ K ), which is 
invariant to permutations of replicas, this does not matter. In the same manner, 
we will from now on treat expressions in terms of overlaps as identical as long 
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as they give the same expectation (. . .) (or, equivalently, without taking the 
expectation but after symmetrizing over all permutations of the replicas). 

We can now state the identities that follow from the ROSt energy expression 
(1T41 . This contains only terms of order f3' 2 on the r.h.s., so comparing with the 
expansion (j42]) shows that our desired identities are simply (E n ) = for n > 2. 
We next obtain a simple recursion for the E n which shows that all these identities 
are of AC form as expected. Consider n > 2 and let S and s be as defined as 
above from the first 2n — 2 summation indices, i.e. S = {a±, . . . , a2n-2} and 
s = \S\. We now start from (|45|) and make a transformation similar to the 
one leading to |46|) but only for these first 2n — 2 summation indices. To this 
end we introduce a sum over s — 2, . . . , 2n — 2 and a corresponding sum over 
(ordered pairs of) ai, . . . , a,2 n -2 constrained so that S has s distinct elements. 
Permutation symmetry tells us that we can compress the range of a\, . . . , a,2n-2 
from 1, . . . , 2n to 1, . . . , s, if we multiply by the number of subsets of size s, 
(2n)\/[s\{2n — a)!]. In this manner we get, if we abbreviate also a — <X2 n -i an d 
b = a 2n , 

1 2 ™~ 2 1 
n! ^— ' s\(2n — s ! 

s=2 y ' 

(») 

x E E (-ir(™~m2n- m )\ q t ia2 --- q i 2n _ 3a2n _ 2q t b . 

o.p.<s l<a<b<2n 

Now we carry out the sum over a and b. The total number of different replica 
indices present, m, depends on the range in which a and b lie: if both are < s, 
we have m = s, if only one is > s, m = s + 1, and if both are > s, m = s + 2. 
Abbreviating Q = <z 2 lCl2 • • • Qa 2n -3a 2n -2 > ^ ne -^ as ^ sum f rom the previous equation 
becomes 

£ (-l) s ( S -l)!(2n- S )!Qg 2 b 

l<a<b<s 

+ E E (-l) s+1 S !(2n- S -l)!Q^ b 

s<f><2n l<a<s 

+ E (-l) s+2 (^ + l)!(2n- S -2)!Q^ (48) 



s<a<b<2n 



Exploiting permutation symmetry among replica indices in the range s+1, . . . 2n 
— given that Q is a function only of replicas 1 , . . . , s — and gathering prefactors 
simplifies this further to 



(-l) s ( S ~iy.(2n~s)\Q 



E2 2 S{S-\-l) . 

9ab — s 2-^1 la, s + 1 ^ 7, 9s+l, S +2 



S (5 + l) r2 

2 

l<a<fc<s l<a<s 

(49) 

Denote the "AC factor" in the square brackets by A s . Given that this expres- 
sions will only be used under the expectation (...), which effectively symmetrizes 
it over permutations of replicas, one can use any integer larger than s in defining 
this factor, and in particular one can replace A s by A2 n -2- 
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Overall, by inserting into (H71) we can write the coefficient E^ K as 




—2 



A 2n - 2 



(50) 



and so by comparison with (|46[) we get the elegant recursion 





q\ 2 A 2 A A ■■■A 2 . 



!n-2 



(52) 



This shows clearly that the identities (E^ K ) — for n > 2 are in fact all 
of AC type. Each such identity corresponds to the stochastic stability of the 
polynomial E^± of the order below. Note that because we have already used 
permutation symmetry to rewrite the summation over a\, ... , a 2n - 2 in terms of 
-Eji-i, the fully symmetric forms of the AC factors have to be maintained, e.g. 
in A 2 = q\ 2 — 2(g 13 + q 23 ) + 3q| 4 one cannot replace q 23 by qf 3 . 

The explicit form of £^ K shows that only a subset of all AC identities is found 
from the energy term expansion: one has only one E n for each n (whereas from 
n = 3 upwards there are more stochastically stable monomials that one can use 
in place of to produce different AC identities), and functions of odd order 
like <7i2(7i3923 are missing altogether. 

5 Expansion in the VB model 

In the VB model the perturbation Hamiltonian is 



where Pg is a Poisson variable of mean a, i v and j v for each v are distributed 
uniformly over {1, . . . , M}, and J v for each v is ±1 with equal probability. The 
expectation in the general expansion (|38[) is then 



(H( T ai )---H(T a ^)) = 

= E Ps ]T E(J,, 1 ...J, 2 J(< 1 i r^...<-^ 2: ). (54) 



The average over the J vanishes except when the vi , . . . , v 2n coincide in pairs or 
larger groups of even size, in which case it equals unity. The different patterns 
of groups that can occur are precisely the even integer partitions of 2n, i.e. the 
integer partitions of n multiplied by two. We characterize such a partition of n 
by the number of times k p each integer p occurs, such that n — ^2 p pk p (where 
the sum over p runs, here and in the following, from 1 to n). For n = 3, for 
example, the three different partitions are (/ci,fc 2 ,fc 3 ) = (3,0,0), (1,1,0) and 
(0, 0, 1), corresponding to 3 = 1 + 1 + 1, 3 = 1 + 2, 3 = 3. These correspond 




(53) 



l<U 1 ,...M 2 n<Pa 
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respectively (after multiplication by two) to there being three pairs of distinct 
v's, one pair and one group of four, and one group of six (v\ — . . . — vq). For 
each partition, there are (2n)\/(J\ p (2p)\ kp k p ^ possibilities — remember that 
the group sizes in the partition of 2n are 2p, not p — of assigning Vi , . . . , i>2n 
and the corresponding replica indices ai, . . . , am to groups of the relevant sizes. 
Finally, given that each partition contains g = ^ p k p different groups, there are 
P&{P& — 1) ■ • • (-Pa — 9 + 1) = Pa-/{P& — .?)! ways of assigning a value of v to 
each group. Putting everything together gives, if denotes a sum over all 

distinct integer partitions (k\, . . . , k n ) of n, 



(H(r ai ) ••• i?(r Q2 ")) = 
(2n)! 



E 



- n P (2p)! fe »v 



E 



(2n)!a- 



(9a ia2 ... >< ■■• >< 9 2 .a 2 „_ lQ2 J- (55) 



Here the subscripts in the overlaps are arranged in accordance with the spe- 
cific partition considered, e.g. for n = 3 and (fe) = (3, 0, 0) - corresponding to 
6 = 2 + 2 + 2- the overlap product is q 2 aia2 q 2 a3ai q 2 a5ae while for (k) = (1, 1,0), 
which corresponds to 6 = 4 + 2, it is ql ia2a3ai 9a 5 a 6 ■ ^ n * ne nne above, the sub- 
scripts to {ig,j g ) are arranged similarly, e.g. for (fc) = (1,1,0) the first 
four replicas (or more precisely replica indices) have subscripts (ii,ji) and the 
last two have subscripts {12^2)- Note that in this way we have picked out one 
particular assignment of replica indices to the groups of the partition, and mul- 
tiplied accordingly with the number (2n)\ / {J\ p (2p)\ kp k p \) of such assignments. 
This is on the understanding that the quenched average we are considering is to 
be used inside a symmetric sum over ai, . . . , am (to get the correct expression 
for a single setting of these summation variables we would need to symmetrize 
by averaging over all permutations avi), . . . , a v n n \). 

To proceed, one inserts (|55l) into the general expansion (f3"5f . For the terms 
with n > 2 one could, as in the SK case, switch to sums over ordered pairs, 
but this is not as useful here as it does not prevent reductions in the order 
of the overlaps, e.g. we would still get q 2 2 i2 — 1- We therefore leave the sum 
unrestricted and write 

n 

e VB = _^^2„^- g<jB VB )) (56) 
n>l g=l 

where the coefficient is a sum over all integer partitions (k) of n with g 
terms: 

'C = E TTki K [:,7] 

(fc):ff=£ Q fc. ""' 



E — 



E ^ = wf(# E Mr- (58) 

V / ll p \ f) l<ai,...,o an <2n 



x (to- l)\(2n-m)\ql ia2 _ X ••• X q 



■a.2n-lO,2n 



Let us discuss briefly how the above expression would change if we were 
considering Gaussian couplings J„. Here, within a group of size p, one would 
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have E[J^ P ] = (2p)\/(p\2 p ) instead of = 1 for the binary case. The only change 
for the case of Gaussian couplings is therefore that in the factor (2p)\ p is 
replaced by (p\2 p ) k " . 

We briefly compare (|57l58p with the corresponding result for the SK 
model, which after reinstating f3' — » (3'(N/2) 1 / 2 reads 

6 sk = _ J2(N^' 2 /2) n (E^ K ). (59) 



In the VB case, to get the Boltzmann RaMOSt we need to set a — Na. Defining 
also $ 2 = 2af3' 2 as the equivalent SK temperature, the VB result ([561 is 

n 

n>l g=l 

= -^(7V/3 2 /2)"E(iV«) s - n « 5 B >. (60) 

n>l 5=1 

We see that, as it should be, precisely the SK contribution (|51?1) survives in the 
limit a — ► oo taken at fixed /3: this is the contribution with the largest number 
g = n of groups, where (fc) = (n, 0,...,0) and the combinatorial factors are 
= l/n! aad l/Y[ p (2 P )\ k * = 1/2", giving E™ = E (n , _ 0) /n\ = E? t K 
by comparison with (|43|) . 

We can now write down the AC-like identities for the VB model that are 
obtained from the energy term (|29[) of the RaMOSt. The r.h.s. of this exact 
expression contains only linear terms in a, so comparison with (|56p shows that 
we must have (E^) = for g > 2 (hence from n > g also n > 2). In spite of the 
mixing of various orders of (multi-)overlaps, one can still get a recursive factor- 
ization of the E^ as we now show. Start from (|55|) . and suppose the last overlap 
in the product is of order 2p (corresponding to a term of this size in an integer 
partition of 2n). We want to do the sum over a 2 ( n -p)+i, ■ ■ ■ ><22n- By analogy 
with the SK case, denote by s the size of the set {ai, . . . , a2(n-p)}- Introduce a 
sum over s, and a corresponding constrained sum over oi, . . . , a-2(n-p) \ ln t ne lat- 
ter, compress the summation range to 1, . . . , s and multiply by (2n)!/[s!(2n — s)l] 
to make up for this. We get in this way 



E (k) 



1 2(n-p) 



Il p ,(2p')! V ^ s!(2n-s) 

(«) 

^ 3aia 2 ... X 



2 

x 



l2(n-p)-lQ2(n-p) 



l<ai,...,a 2 („_ p )<s 



^ (-l) ro (m-l)!(2n-m)!^ 2(n _ p)+i a2n .(61) 

l< a 2(7i-p) + l.---, a 2n<2n 

We now focus on the sum in the last line; call it E. The complications in 
evaluating this arise because whenever a replica index occurs twice (or more) it 
cancels and we get a lower order overlap. So we need to consider again integer 
partitions, now of 2p, to tell us how such identical indices group. Let (k) = 
(ki, . . . , K2 P ) denote such a partition, with ^ r tk t — 2p (where r — 1, . . . , 2p 
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here and below) . If replica indices occur in groups of identical values according 
to such a partition, all the even groups cancel completely from q, and we get 
a multi-overlap of order 70 = J2rodd Kr gi yen by the number of odd groups. 
Define also j e = ^ reven «V, the number of even groups, and 7 = 70 + 70, the 
total number of groups. For every partition, there are {2p)\/(\\ r r\ Kr n r \) ways 
of arranging the replica indices into groups of the given size. 

Finally, we need to account for which actual replica index value in the range 
1, . . . , In is used for each group of identical indices. All groups need to have 
distinct index values (since groups are defined as subsets of the summation 
variables a 2 ( n - p )+i, . ■ ■ , a2„ having identical values). We split the sum over 
all possible assignments of index values according to the number of groups of 
odd size, h-0 < 70, having high index values > s, and the number of even 
groups, h e < 7c, with such high index values. We need these quantities to 
determine the overall number m of distinct index values, given that the values 
{1, . . . , s} occur already in the first line of (jBTj) : m = s + h0 + h c . An explicit 
summation is required only over the 70 — h0 (low) index values b\, ... , & 70 -h 
of the odd-sized groups that are in the range 1, . . . , s. The other (high) index 
values of the odd groups we can set to s + 1, . . . , s + h0 by replica permutation 
symmetry. The index values of the even groups we never need explicitly because 
they disappear from the overlap. We take the 61, . . . , & 70 _^ as ordered and 
then just need to work out how many index value assignments there are for a 
given setting of these indices: J0l/[h0\(j0 — /10)!] ways of choosing which odd 
groups have high index values, and similarly 7 e !/[ft, e !(7 e — /i e )!] ways for the even 
groups; (70 — h0)\ ways of permuting the b\, ... , b 10 -h among the odd groups 
with low index values; (2n — s)!/(2n — s — h0)\ ways of assigning index values 
to the odd groups with high indices (the order matters); and similar factors 
[s- (70- k0)]l/[s— (70-/10) - (7c - /i e )]! and (2n-s-h0)\/(2n-s-h0-h e )) 
for the number of ways of assigning index values to the even groups with low 
and high indices, respectively. Putting everything together, we have 

s = E n (2 fi ! 1 j2(- i y +h0+h ^ s+h0+h °- i y-( 2n - s - h0 - h °y- 
(«) ii '' r - rKr - h ,h c 

70! 7e ! ( _ (2n-s)! 



r(70-/l0)! 



/i0!(70 - h0)\ /i e !(7e - h e )\ (2n - s - h0)\ 

[s - (70 - h0)] ! (2n - s - h0) ! 

[s - (70 - h0) - (7c - /i e )]! (2n -s-h0- h e )\ 

X Qb 1 ...b je - h0 ,s+l,...,s+h0 
l<6i<...<fc rf( _( M ,<« 

v (2p)!(2n-s)! v +h0 70! [a - (70 - Ml' 
Y\ r r\^ Kr \ > h0\ 

(k) llr h0 



E 



-J _^_ 1 ^ e (s + h0 + h c - 1)! 



/i e !(7e - h e )\ [s- (70- h0) - (7 e - /i )]! 

— h.0 j 

(62) 

1<&1<. ..<6 70 _ hB <s 



IS 



The sum over h e can now be done, using that for a > b 

V - ( l) ^ a + k ^ = (*-b)lal ( , 

£^k\(n-k)\ y ' [b + k)\ K ' (a-b- n y.{b + n)\ 1 ' 

(Factorials are treated like the corresponding Gamma functions here, i.e. when 
a — b — n is negative, (a — b — n)\ is infinite and the result vanishes.) In our case 
k = h c with n = 7 C , a = s + h0 — 1, b = s + h0 — 70 — 7 e so that 



= v (2p)!(2n-a)! v na+fe0 70![a~ (70 ~ M]' 
x(-l)> 



(64) 



( K ) llr ' h0 

( 70 + 7c- l)!(s + /i0- 1)! 
(70 - l)!(s + /10 - 70)! 

X 9bi...fc T0 _ )l0 ,s+l,...,s+/i0 

l<fci<...<fc T0 _ ha <s 

- E (2p)!( -' r ; ( :^ ! ? 2 "- a) ' (-^^- 1 ) ! ^ 

with the higher-order AC factor (note As = ^4 S ) 

^4(70) = ^ (~l) h0 ^ ,/ _ X! 96 1 ...6^ _ fc0 , s +l,..., s +h0 ( 65 ) 

/!0=O ' V l<6i<...<6 Ta _ fto <s 

Regarding the summation range for /10 in this definition, note that in the 
factorials give the restriction that s + h0 — 70 > 0, hence ft.0 > 70 — s. This 
is ensured if in (|65|) we assign the sum the value zero when there is no possible 
ordered assignment of the summation variables because there are more than s 
such variables. For 70 = 0, on the other hand, h0 — also and so there are no 
summation variables in (1651) . In this case the sum can be set to unity, but in 
fact because of the factor 70 in (|551) we never need to evaluate . 
The factor (s — 1)! in (|65|) . which diverges for s = 0, signals that this case 
needs to be checked separately. Because s — |{oi, . . . , a2( n _ p )}| this case can 
occur only if n — p, in which case s = is the only possible value. The apparent 
divergence in the (s— 1)! factors can be traced back to the factor (s+h0+h e — 1)! 
in (1621) . which looks divergent for h0 = h c = 0. However, when s = 0, we must 
have h0 = 70, h c = 7 e and X from (|62j) simplifies to 



S ° = E n ■ (- 1 ) 70+7 °(70 + 7e - 1)! gL.70- (66) 



Because 70 + 7 = g > 1 , the potentially offending factorial does indeed stay 
finite. Note that for this s = expression the 70 = term does not vanish 
automatically as was the case for s > 1. The factor (— I) 70 can be dropped 
because 70 must be even (since 2p is). Note that can be regarded as a 
special case of (|65l) if in the latter one first cancels the factor (s — 1)! (inserted 
into A^ 1 ^ for s > 1 to get a simple form), then sets s = and n — p, and finally 
cancels J0(h0 — l)\/h,0\ — 1 because h0 — 70. 
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To summarize, the sum E takes the form (|65p when s > 1, which is always 
the case for p < n, while for s = and hence n = p it is given by (|66p. We now 
just need to replace the last line of (|6"Tj) by this to find, for p < n, 

1 2(n-p) / jN, ( s ) 



B ffc1 = _ \ i — '— \ n 2 - x • • • x (67) 

l<ai,...,a 2 („_ p )<s 



V \^ 



x^-^a^ x E w^M^— f(-l) 7o 70(70 + 7c - 1)! A™ 



(«) 

while for n = p and hence (fc) = (0, . . . , 0, 1) 

s (°>-ad = E n ^Ti ( ~ 1)7e(70 + 7e ~ 1)!gL ^- (68) 

To make (f6"7} into a recursion just takes a few more steps now. Call the sum 
over partitions in the second line, without the factor (2p)!, 

B * 2p) = E rr ik , (^i) 7c 70(70 + 7c - l)! 4 70) (69) 
(«) Ur r - Kr- 
Orie now shows that, as for the second order case 70 = 2 and because of per- 
mutation symmetry among replicas with indices > s, also in the higher order 
AC factors Ai 70 ' one can replace s by any larger integer and in particular by 
2(n — p). The same replacement can then be made in B^ p \ In the first line of 
(|67p . one re-expands the summation range on the 01, . . . , CL2(n-p)-> but now only 
to 1, . . . , 2n — 2p and correspondingly divides by (2n — 2p)\/[s\(2n — 2p — s)!]. 
The sum over s and the constraint of having s distinct summation indices can 
then be combined into an unconstrained sum, where s = |{ai, . . . ,a2(n-p)}| : 



1 1 



(2n-2 P y.ll pl (2p')l k p'- 5 p'p 

E (-l) s (.s-l)!(2n-2p-,s)! 



x 

l<ai,...,a2( T1 — p )<2n- 2p 



X ll ia2 ... x ' ' ' x 9 2 .a 2( „_ p) _ 1 a 2( „_ p) B Li-2p- ( 70 ) 

Comparison with (|58p now shows that there is again a simple recursion: 

E{k) = ^(...,fc p -l,...) B 2n P -2p ( 71 ) 

and starting from (|68p every Effy can be expressed in factorized form. The 
main difference between the VB and SK cases is that the factors entering at 
each step of the recursion are a mixture of AC factors of different orders (from 
2 to 2p). Also the final coefficient (|57| at a given order is a sum over a number 
of factorized expressions, one for each even integer partition of 2n containing 
the specified number g of groups. 

To get explicit expressions for the lowest order coefficients E„g we just need 

the initial values from (1551) and the factors i?g 2p ' . We start with the former: for 
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p = 1, there are only two different partitions of 2p = 2: 

(k) 70 7o n^! Kr «r! (-1)^(70 + 7e-l)! 

(0,1) 12 -1 (72) 

(2,0) 2 2 1 

so 

E { i) = \{-l + ql 2 ) (73) 

as expected because this polynomial should equal Ef K . For p = 2 one gets 
similarly 

(«0 70 7c nr r! " r «r ! (-l) 7c (70 + 7c-l)! 

(0,0,0,1) 1 24 -1 



(0,2,0,0) 2 8 1 

(1,0,1,0) 2 6 1 

(2,1,0,0) 2 14 -2 

(4,0,0,0) 4 24 6 



(74) 



and thus 



= + + i)«i2 + ^<&34 = ^(l-4g 12 + 3g 1234 ). (75) 

For the first B-factor we again need the integer partitions of 2p = 2: 

(k) 70 7c Ilr r!KrK '' ! (-l) 7o 70(70 + 7c - 1)! 

(0,1) 1 2 (76) 

(2,0) 2 2 2 



so 



bP=A^. (77) 



The first nontrivial B- factor is the one for p — 2, where we need integer parti- 
tions of 4: 



(«) 


70 


7e 




(-: 


(0,0,0,1) 





1 


24 





(0,2,0,0) 





2 


8 





(1,0,1,0) 


2 





6 


2 


(2,1,0,0) 


2 


1 


4 


-4 


(4,0,0,0) 


4 





24 


24 



1)! 



(78) 



so that 



= (~ ~ ~) 4 2 > + ^ = -^ 2 > + 4 4) - (79) 



One sees that the terms with the highest-order multi-overlap follow a simple 
pattern: in -B(o,...,o,i)? 9i 2p nas a prefactor of l/(2p), while in the expression 
for Bi 2p \ the AC polynomial Af p) occurs with unit coefficient. Both of these 
observations follow from the fact that for 70 = 2p there are no even groups 
(7c = 0) and the partition of 2p has to be (re) = (2p, 0, . . . , 0). In ((68]) one has 
then (-1)^(70 + 7c - l)\/Y\ r r\^K r \ = (2p - l)!/(2p)! = l/(2p), while in (52), 
(-1)^70(70 + 7 c - l)\/Y\ r r\^n r \ = 2p{2p-l)\/(2p)\ = 1. 
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Equipped with the above initial values, the recursion (fTTj) and the definition 



([57)) we can now get the relevant VB coefficients up to n = 4: 

E™ = E W = \{-l + <ll 2 )=E^ (80) 

= E m = ±(l-4q 2 12 + 3qt 2U ) (81) 

El B = ~£( 2 ,o) = \E (1) B { 2 2) = \{-l + ql 2 )A { i ] = E S 2 K (82) 

E31 = ^(0,0,1) = • ■ ■ + g9l23456 (83) 

£3? = ^(i,i,o) = E (1) B^ = l(-l + q 2 12 )(-2A^ + 3A^) (84) 

or = £ (0)1) sf = i(l-4^ 2 +3<& 34 )4 2) (85) 

^ 3 V 3 B = ^(3,0,0) = ^(2,o)Si 2) = \e (1) bPbP (86) 

- i(-l + A)4M 2) =^f K (87) 

-^41 B — ^(0,0,0,1) = ■ • • + g?12345678 (88) 

^42 B = ^(1,0,1,0) + 2^(0,2,0,0) = ^-(0,0, l)^ 2 ' 1 + T^t ' 1 )- 8 ^ (89) 

- (• ■ • + faj) 4 2) + (1 - 4& 24 +3&34) (-1 4 2) + 4 4) >o) 

^4 V 3 B = ^(2,1,0,0) = ^(1,1,0)4 2) = ^(0,1)4 2) 4 2) (91) 

= ^(l-4g?2 + 3g?23 4 )4 2) 4 2) (92) 

< B = ^(4,o,o,o) = ^(-l + ^ 2 )4 2) 4 2) 4 2) =^4 SK (93) 



Note that in all terms with g > 2, which are the ones we are interested in because 
they give us the identities (E^) — 0, the constant contribution in the factor 

^(0,...,0,i) can be dropped. E.g. in -E^ B , we can symmetrize in (— 1/12)4 2 ^4^ 

(2) 

across the replica indices 1, 2, 3, 4 because A\ is symmetric in these indices any- 

(2) 

way. But under this symmctrization A 2 vanishes. We have already exploited 
this in writing E% 2 B = £f K , E^ = £f K and Ej^ = Ef K above. 

Now consider the various identities that result in detail: (E 22 B ) = is, after 
dropping the constant in the first factor, the standard 4 th order AC relation 
(9i2^2 2 ^) = 0- Next, (£^j B ) = is, after dropping the —1, the same identity 
as for the SK model, {q 2 l2 A ( 2 ] A^) = 0. The relation (Ej 2 B ) = reduces to 

(q 2 2 3iA^) = (the constant can be dropped, and (gi 2 4 2 ^) = (9i 2 4 2 ^) = 0) 
as in [1 22]. In the first form written down above one can similarly reduce 

everything to {q\ 2 A 2 ^) = 0, which must — and does indeed — give an equivalent 
relation, but looks superficially different because we have broken the replica 
permutation symmetry in a different manner. However, this simple pattern 

( 2") 

(of (qi...2 n A 2n ) = 0) does not persist to higher orders, as the n = 4, g = 2 
term shows: this is the first one where one gets a sum over several partititions. 
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After dropping terms that are zero because of lower order identities, (Ej®) = 
becomes 

^(4^ 2 345 6 4 2) +3&344 4) )=0, (94) 

and the two parts cannot be separated, at least not provably so from the energy 
term expansion considered here. 

In (Ejr®), finally, the g^-term can be dropped because 

9l2^4 ^6 ^ = 9l2^4 ^4 ^ 

which has vanishing expectation due to the identity from Ej^. So one gets 

(9?2344 2) 4 2) >=0 (95) 
(£^ 4 B ) = 0, finally, gives the 8-th order SK identity (q^A^A^A^) = 0. 



6 Outlook 

The work presented in this paper was motivated by recent progress [5j I32[ 133] in 
our understanding of relations among ultrametricity |29j and polynomial iden- 
tities [J [22] in mean field spin glasses. We first reviewed the concept of random 
overlap structures [3], both for fully connected and for diluted disordered mean 
field spin systems. Then, starting from an explicit expression for the energy 
within this framework, we compared this to an expansion closer to the ones 
obtained by stochastic stability [H][31] or smooth cavity field [5] methods. We 
analysed the resulting linear set of overlap identities (which usually develop in 
statistical mechanics of quenched disordered systems), referred to as Aizenman- 
Contucci equations pQ. 

We extended previous results [7] [8] both by deriving an alternative and more 
rigorous recursive approach for the derivation of these identities and by showing 
that, at least when considering the energy term of the Boltzmann ROSt/RaMOSt, 
the identities obtained from the low orders of our expansion are in perfect agree- 
ment with the same relations obtained with e.g. the replica trick. Going to 
higher orders in the expansion, on the other hand, we found that the result- 
ing identities are fewer in number than the identities known to hold for the 
Shcrrington-Kirkpatrick [22] or the Viana-Bray [2T] models. 
As the Parisi solution of the SK model (encoded in Ruelle's GREM [37 within 
this framework and called Parisi ROSt) is known to satisfy the whole set of AC 
identities |35j . our work strongly suggests that these further, missing relations 
must be associated with the entropic contribution of the ROSt, on which we 
plan to report soon. 
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